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Abstract Generalizing a recent work [T. Taniguchi and E. G. D. Cohen, J. Stat. Phys. 
126, 1 (2006)] that was based on the Onsager-Machlup theory, a nonlinear relaxation 
process is considered for a macroscopic thermodynamic quantity. It is found that the 
fluctuation theorem holds in the nonlinear nonequilibrium regime if the change of the 
entropy characterized by local equilibria is appropriately renormalized. The fluctuation 
theorem for the ordinary entropy change is recovered in the linear near-equilibrium case. 
This result suggests a possibility that the information-theoretic entropy of the Shannon 
form may be modified in the strongly nonlinear nonequilibrium regime. 
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I. INTRODUCTION 

Thermodynamics is concerned with the averages of macroscopic physical quantities, 

whereas equilibrium statistical mechanics can give information on fluctuations around 
the averages. Einstein's 1910 theory of fluctuations [1,2] builds a bridge between the 
two based on the thermodynamic entropy and the reversal of Boltzmann's relation for it. 
In nonequilibrium, fluctuations are considered to play a vital role and may cause a 
richer variety of phenomena than those in equilibrium. In spite of a lot of efforts, it 
seems fair to say that simple and complete laws could not have been found for 
describing universal physical properties of fluctuations in system states far from 
equilibrium. However, the situation has changed when the so-called fluctuation theorem 
was formulated in the middle of 1990' s [3,4]. 

The fluctuation theorem reveals a kind of symmetry hidden behind the distributions 
of the entropy change, quantity of heat, work and so on in nonequilibrium situations. It 
holds for stochastic systems [5,6] as well as deterministic chaos [4]. Also, several real 
experiments have been performed, and good agreements of the predictions of the 
theorem with the experimental results have been reported [7-9]. 

In a recent work [10], the fluctuation theorem has been rederived by making use of 
the Onsager-Machlup theory [11], in which the existence of local equilibria and linearity 
of relaxation process are essential premises. Discussions of this kind are of obvious 
importance, since a macroscopic theory (i.e., thermodynamics) plays a guiding role for 
consistently developing a microscopic approach (i.e., statistical mechanics). The authors 
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of Ref. [10] apply a constant external dragging force and consider the fluctuations of 
work, friction, and quantity of heat. A problem of crucial importance here is that the 
linear approximation is not legitimate in the strongly nonequilibrium regime. 
Accordingly, the external force cannot be so strong either. 

In this paper, we generalize the discussion in Ref. [10] to a nonlinear case and show 
that the transient fluctuation theorem still holds if the change of the entropy 
characterized by local equilibria is appropriately modified. This modified quantity is 
referred to as the "renormalized entropy change". Our result suggests a possibility that 
the ordinary information-theoretic entropy of the Shannon form may be modified in the 
strongly nonlinear nonequilibrium regime. 

II. NONLINEAR NONEQUILIBRIUM PROCESS: GENERALIZATION OF 
THE ONSAGER-MACHLUP THEORY 

To be self-contained, this section is devoted to the preparation for our main 
discussion in Sec. III. 

Suppose that the total system consists of the objective system and the surrounding 
environment and is initially not in equilibrium. Consider the evolution of a macroscopic 
physical quantity of the objective system, the energy (j) here, along a process from a 
given arbitrary initial state to a certain nonequilibrium stationary state. We formulate 
the dynamics of by employing the Langevin equation 
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dt 



(1) 



Here, F(<j>) is a current and £ is the Gaussian white noise satisfying 



l(0=o, 



Z(t)£(f) = 2D8(t-f), 



(2) 



where the over-bars stand for the averages over the noise distribution. 

Onsager and Machlup [11] assume the initial state of the objective system to be close 
to equilibrium and discuss its relaxation to equilibrium. Accordingly, they are able to 
express the current in terms of the thermodynamic force, d S tot (<p) I dip , as 
F(<p) = LdS tot ((p) / dip, where S tot (<p) and L are the total entropy and the transport 
coefficient, respectively. Since the total system is in a state near equilibrium, its entropy 
can well be approximated by a quadratic function [1,2]: S tot ((p) = const. - (1 / 2)a<p 2 
with a>0 (here, O yielding S tot ((j) ) = max is taken to be zero for the sake of 
simplicity). Accordingly, the distribution of fluctuations, 0, is Gaussian: 
Poo (0) x e x P[S tot (0)] ~ exp[-(l / 2)a0 2 ] (Boltzmann's constant being set equal to 
unity), and the Langevin equation in Eq. (1) becomes linear. To realize a 
nonequilibrium stationary state, the authors of Ref. [10] introduce a constant external 
dragging force. 

A point here is that if the entropy is a quadratic function and the external force is not 
applied, then the physics is well determined in the neighborhood of = O (=O). 
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However, for a far-from-equilibrium system exhibiting slow relaxation, the entropy is 
not quadratic and may have a complex landscape with a number of local maxima, in 
general. Therefore, in such cases, the state of the system can still be characterized 
around local maxima even without external dragging forces. Thus, we renounce the 
linearities of both the current and the thermodynamics force with respect to (j) and do 
not apply external dragging forces. 

To find one such nonequilibrium stationary state, we consider the following Fokker- 



Planck equation for the probability distribution p(0, t) = 8((j)- (j)Jt)) : 



*. [F « )pi t m+D rm!>, ( 3) 



where (f)Jt) is the solution of Eq. (1). A stationary solution of this equation is given by 



p s ((j))oce zw , (4) 



where E(0) is connected to F((j)) as follows: 



F(« = D^>. (5) 



Later, we shall see how E(0) is related to the renormalized entropy change. 

Take a time interval [0, t] and impose the boundary conditions, 0(0) -X and 
0(t)= Y. The forward transition probability from X to Y is given by the following 



functional integral [12,13]: 



*(r)=r 



f F (Y,r\X,0) = N$D% | D0<5[0-^]exp[-^jj;<f(O 

0(O)=X 

= tf $ Dip Det 



0(O)=X 



' J dF(<p)^ 



AD 

S(t-t') 



xexp 



dt d<p 
4D{ [dt dip J 



(6) 



where the subscript "F" denotes the forward process [6], N is a normalization factor that 
will commonly be used throughout this paper, 8[(j) - (j)^ = |J 8 (<p(t) - (p^(tj) , and the 
functional determinant is defined for the continuous indices t and t' . 



To evaluate the determinant, we employ the standard manipulation [13]: 



Det M = exp (Tr In M), where 



M(t, f ) 



f d dF(<pf 
dt dip j 



8{t-f). 



(7) 



Write the matrix as follows: 



M(t, f ) = 



K dtj 



K(t, n, 



(8) 



K(t, t') = 8(t-t')-0(t-t') 



d(p{f) ' 



(9) 



where 0(x) is the Heaviside step function. Notice that we are using the "forward 
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propagator", O(t-t'), in Eq. (9). Absorbing exp[Tr In (J / dt)] in the normalization 
factor and expanding the logarithm, we have 



ln(Dettf) = -0(O) \dt d ^- 
i d<$> 



-- \dt, \dt 2 e(t l -t 2 )6(t 2 -t 1 ) — — yj^iL 

^ J 1J 21 2 2 1 d<f>(t x ) d<j>(t 2 ) 







(10) 



In this series, only the first term survives because the products of the step functions 



vanish. Setting 0(0) - 1 / 2, we obtain 



Det M oc exp 



A) dt d_im 

2 { 



(ID 



Consequently, the forward transition probability is expressed as follows: 



f F (Y, t\X, 0) = N J D^exp -J^L 



0(O)=X 



^ dt L 



(12) 



where 



L = 



4D 



d4 

dt 



-F(0) 



+ 



1 

2 



(13) 



is the "thermodynamic Lagrangian". The second term on the right-hand side highlights 



an effect of the nonlinearity. 
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III. FLUCTUATION THEOREM FOR THE RENORMALIZED 

ENTROPY CHANGE 

With the preparation in the preceding section, now we are in a position to discuss a 
transient fluctuation theorem in a process from a given arbitrary initial state, p(X, 0), 
to the nonequilibrium stationary state, i.e., p s (0) in Eq. (4). To find a relevant physical 

quantity, first we consider the time reversal operation: t = -t . is assumed to 
transform as a scalar variable: 0(0 = 0(F). Under this operation, the thermodynamic 
Lagrangian transforms as 



L(d$(t) I dt, 0(0) = L(d0(F) I dt, 0(F)) + -^F(0(F)) 



<i0(F) 
dt 



(14) 



Quite remarkably, the second term on the right-hand side is the F -derivative of 



E(0(F)) with E appearing in Eq. (5). That is, 



L (d(/)(t) I dt, 0(0) = L [d<j>(t) /dt, 0(F)) 



+ 



dt 



(15) 



Accordingly, the transition probability changes as follows: 



0(-T)=y r o 

f F (Y,r\X,0) = N e UY) - nx) \ D~§ exp -J dt L (d<j)(t) I dt, 0(F)) 



(16) 



Doing the shift, F = F + T, and noticing 0(F) = 0(F) as well as the invariance of the 



functional integral part under time translation, we obtain 

f F (Y, TlX, 0) p s (X) = f F (X, t\Y, 0)p s (Y), (17) 

where p s is the nonequilibrium stationary state in Eq. (4). Thus, in the present 
nonlinear nonequilibrium system, holds the detailed balance condition, which is 
regarded as a remnant of microscopic reversibility [14]. Notice, however, that the 
quantities treated here are the macroscopic thermodynamic variables. 

It is also noticed that if the total derivative term is not extracted in Eq. (14), one 
obtains the reverse transition probability f R (X, t\ Y, 0) , which is related to the forward 
transition probability as follows: 

f F (Y,t\X,0) = f R (X,T\Y,0) 



N | D^exp -JjfL 

V o J 



<*(T)=X 



(18) 



where 



AD 



at 



J 



(19) 

2 d<p 



Now, the proof of the fluctuation theorem is straightforward. The quantity to be 
considered is L (</)), as suggested by the structure in Eq. (17). So, let us evaluate in the 
following way the probability that the amount of its change along a process from a 
given arbitrary initial state, p(X, 0), to a nonequilibrium stationary state, p s (<p), 



during the time interval [0, t] is AZ : 



P F (AZ)= 5 



AL-\ dt — ^ 

„ dt 



V o 



= \\dX JF <5(AZ - [Z(F) - Z(X)]) / F (F, tIX, 0) p(X, 0) . (20) 



From the detailed balance condition in Eq. (17), we have 



P F (AL) = e AL Jj dX dY 8{AL - [Z(F) - Z(X)]) f F (X, t\Y, 0) p(X, 0). (21) 



Interchanging the integration variables, X and Y, and using Eq. (18), we find 



P F (AL) = e AE Jj JF <5(-AZ - [Z(F) - Z(Z)]) f F (F, tIX, 0) p(F, 0) 
= e^\\dXdY <5(-AZ - [Z(F) - Z(Z)]) / A (X, tIF, 0) p(F, 0) 



= e 



.AE 



-AZ-J dt 

V o 



\ , dZ((j)(t)) 



dt 



JIr 



= e AZ P s (-AZ). 



(22) 



where the subscript "7?" indicates the reverse process [6]. Therefore, we obtain 



= e , 



P S (-AZ) 



(23) 



which is the main result of the present work. 
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A remaining task is to elucidate the physical meaning of the quantity, AE . Clearly, it 
is not the change of the ordinary entropy, S" ot (0), defined by local equilibria. From Eq. 
(5), we find that 



dt D dt 

_ 1 ^(Q dS tot ((j)) 
D r dt 



(24) 



where x(T) = in which (j) is solved in terms of the affinity [15] defined by 



r = ^M. (2 5 ) 

d(j) 



If the total entropy is given by the sum of the entropies of the objective and 
environmental systems, then F is given by the difference between the inverse 
temperatures of these subsystems. Equation (24) puts a basis for calling AE the 
renormalized entropy change. 

In a particular case when the total system is in a state near equilibrium, the linear 
approximation is valid well: that is, ^(r) = LT with the transport coefficient, L, 
satisfying the fluctuation-dissipation theorem, D = L. Then, Eq. (23) becomes reduced 
to the transient fluctuation theorem for the entropy change, which is known in the 
literature (see Ref. [16], for example). 
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V. CONCLUSION 

We have examined the fluctuation theorem by generalizing the discussion in Ref. 
[10] to the case of a nonlinear slow relaxation process for the macroscopic 
thermodynamic energy. In this way, a system in a state far from equilibrium is 
consistently treated. We have found that the transient fluctuation theorem holds if the 
entropy change is appropriately renormalized. This result suggests a possibility that 
Shannon's definition of the entropy, 5 = — , Pi^ n Pi (with a probability distribution 
{/?,}), which is connected to 5 tot through the maximum entropy principle [17], may be 
modified in the strongly nonequilibrium regime. 

ACKNOWLEDGMENTS 

Y. S. would like to thank the Department of Physical Engineering, Mie University, 
for the hospitality extended to him. He is also indebted to the Yukawa Institute for 
Theoretical Physics at Kyoto University, where this work was initiated during the YITP- 
W-07-07 on "Thermal Quantum Field Theory and Its Applications". S. A. thanks Eddie 
Cohen for discussions. This work was supported in part by Grant-in- Aid for Scientific 
Research (B) of the Ministry of Education. 

REFERENCES 

[1] A. Einstein, Ann. derPhys. 33, 1275 (1910). 

12 



[2] L. D. Landau and E. M. Lifshitz, Statistical Physics 3rd edition (Pergamon Press, 
Oxford, 1980). 

[3] D. J. Evans, E. G. D. Cohen, and G. P. Morriss, Phys. Rev. Lett. 71, 2401 (1993): 

Erratum 71,3616 (1993). 
[4] G. Gallavotti and E. G. D. Cohen, Phys. Rev. Lett. 74, 2694 (1995). 
[5] J. L. Lebowitz and H. Spohn, J. Stat. Phys. 95, 333 (1999). 
[6] G. E. Crooks, Phys. Rev. E 60, 2721 (1999); ibid. E 61, 2361 (2000). 
[7] G. M. Wang, E. M. Sevick, E. Mittag, D. J. Searles, and D. J. Evans, 

Phys. Rev. Lett. 89, 050601 (2002). 
[8] S. Ciliberto, N. Gamier, S. Hernandez, C. Lacpatia, J.-F. Pinton, G. R. Chavarria, 

PhysicaA340, 240 (2004). 
[9] N. Gamier and S. Ciliberto, Phys. Rev. 71, 060101(R) (2005). 
[10] T. Taniguchi and E. G. D. Cohen, J. Stat. Phys. 126, 1 (2006). 
[11] L. Onsager and S. Machlup, Phys. Rev. 91, 1505 (1953). 
[12] E. Gozzi, Phys. Rev. D 30, 1218 (1984). 

[13] J. Zinn- Justin, Quantum Field Theory and Critical Phenomena, 4th Ed. (Oxford 

University Press, Oxford, 2002). 
[14] R. C. Tolman, The Principles of Statistical Mechanics (Dover, New York, 1979). 
[15] M. Le Bellac, F. Mortessagne, and G. G. Batrouni, Equilibrium and 

Non-Equilibrium Statistical Thermodynamics (Cambridge University Press, 



13 



Cambridge, 2004). 
[16] U. Seifert, Phys. Rev. Lett. 95, 040602 (2005). 

[17] E. T. Jaynes: Papers on Probability, Statistics and Statistical Physics, edited by 
R. D. Rosenkrantz (Kluwer, Dordrecht, 1989). 



14 



